Web Document Modelling and Clustering*

Great number of the web documents, created by people of a great variety of walks and used by all the people being able to access to the Internet, gives rise to a problem of how to search the Internet to easily obtain what users want and to filter out what they don't. The problem is strongly related to how to describe or characterize the web documents. On the other hand, labels are being introduced to cluster the web documents. These labels are generated by different people using various categorization models so that conflicts may arise. An introduction of a web document model is undoubtedly necessary for analysis and formulation of web documents, hence for formal clustering of the web documents. In the SISU-PICS project, we propose a web document data model (WDM) to represent various characteristics and components for identifying web documents. We also establish a set of relatedness and similarity relations between WDM objects for computing web document clustering.